CLAIMS 

WHAT IS CLAIMED IS: 

1 . An image processing device for smoothing image data that is formed by a 
plurality of pixels and includes at least one color component, comprising: 
5 smoothing means for selectively performing, for at least one color component of 

a target pixel, smoothing that uses pieces of color information of at least one color 
component of the target pixel and of pixels adjacent to the target pixel among a plurality 
of pixels that form the image data, the smoothing done in accordance with correlation 
between the target pixel and pixels in the vicinity of the target pixel. 

10 2. An image processing device for smoothing image data that is formed by a 
plurality of pixels and includes at least one color component, comprising: 

similarity degree calculating means for calculating similarity degrees indicating 
similarity between a target pixel and pixels in the vicinity of the target pixel among a 
plurality of pixels that form the image data; 

15 classifying means for classifying pixels whose similarity degrees have been 

calculated by the similarity degree calculating means into one of a plurality of groups 
having different similarity degree features; and 

smoothing means for selecting a pixel to be subjected to smoothing from among 
a pixel that has been classified into a particular group in the plurality of groups and pixels 

20 in the vicinity of the pixel that has been classified into the particular group, and for 
performing smoothing on color information of at least one color component of the 
selected pixel by using pieces of color information of at least one color component of the 
selected pixel and of pixels adjacent to the selected pixel. 

3. The image processing device according to claim 2, wherein said smoothing 
2 5 means smoothes color information of a color component of a pixel adjacent to a pixel that 
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has been classified into the particular group by the classifying means, and restores into its 
original state color information of a color component of a smoothed pixel among pixels 
adjacent to a pixel that has not been classified into the particular group by the classifying 
means. 

4. The image processing device according to claim 3, wherein said smoothing 
means: 

sequentially selects pixels that became subjects of classification by the 
classifying means; 

smoothes color information of a color component of a pixel that is adjacent to not 
only a pixel selected at an arbitrary time point but also to a pixel that is not selected at the 
arbitrary time point when the selected pixel is classified into the particular group; and 

restores into its original state color information of a color component of a 
smoothed pixel among pixels adjacent to the pixel selected at the arbitrary time point 
when the selected pixel is not classified into the particular group. 

5. The image processing device according to claim 2, wherein said smoothing 
means smoothes color information of a color component of a pixel that is adjacent to a 
plurality of pixels that have been classified into the particular group by the classifying 
means. 

6. The image processing device according to claim 2, wherein said smoothing 
means uses, as said particular group, a group having a feature that similarity degrees 
calculated in at least two different directions by the similarity degree calculating means 
are approximately the same. 

7. The image processing device according to claim 6, wherein said smoothing 
means judges that similarity degrees in at least two different directions are approximately 
the same when a difference between similarity degrees calculated in the at least two 
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different directions by the similarity degree calculating means is smaller than a prescribed 
threshold value. 

8. An image processing device for smoothing image data that is formed by a 
plurality of pixels and includes at least one color component, comprising: 
5 interpolating means for interpolating pieces of color information of a color 

component that is absent from pixels that are arranged at a prescribed pitch among pixels 
that form the image data; 

similarity degree calculating means for calculating similarity degrees in at least 
two different directions for each pixel to be a subject of interpolation by the interpolating 
10 means; 

classifying means for classifying each of pixels whose similarity degrees have 
been calculated by the similarity degree calculating means into one of a plurality of 
groups having different similarity degree features; and 

smoothing means for selecting a pixel to be subjected to smoothing from among 

15 a pixel that has been classified into a particular group in the plurality of groups and pixels 
in the vicinity of the pixel that has been classified into the particular group, and for 
performing smoothing on color information of a color component of the selected pixel by 
using pieces of color information of color components of the selected pixel and of pixels 
adjacent to the selected pixel. 

20 9. The image processing device according to claim 8, wherein: said smoothing 
means performs the smoothing parallel with the interpolation by the interpolating means. 
10. The image processing device according to claim 8, wherein: 

said interpolating means employs, as subjects of the interpolation, pixels that 
miss a color component having a highest spatial arrangement density; and 

25 said smoothing means smoothes color information of the color component 
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having the highest spatial arrangement density of a pixel adjacent to a pixel that has been 
classified into the particular group. 

1 1 . The image processing device according to claim 8, wherein said smoothing 
means smoothes color information of a color component of a pixel adjacent to a pixel that 

5 has been classified into the particular group by the classifying means, and restores into its 
original state color information of a color component of a smoothed pixel among pixels 
adjacent to a pixel that has not been classified into the particular group by the classifying 
means. 

12. The image processing device according to claim 11, wherein said smoothing 
10 means: 

sequentially selects pixels that became subjects of classification by the 
classifying means; 

smoothes color information of a color component of a pixel that is adjacent to not 
only a pixel selected at an arbitrary time point but also to a pixel that is not selected at the 
15 arbitrary time point when the selected pixel is classified into the particular group; and 

restores into its original state color information of a color component of a 
smoothed pixel among pixels adjacent to the pixel selected at the arbitrary time point 
when the selected pixel is not classified into the particular group. 

13. The image processing device according to claim 8, wherein said smoothing 
2 0 means smoothes color information of a color component of a pixel that is adjacent to a 

plurality of pixels that have been classified into the particular group by the classifying 
means. 

14. The image processing device according to claim 8, wherein said smoothing 
means uses, as said particular group, a group having a feature that similarity degrees 

25 calculated in at least two different directions by the similarity degree calculating means 
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are approximately the same. 

15. The image processing device according to claim 14, wherein said smoothing 
means judges that similarity degrees in at least two different directions are approximately 
the same when a difference between similarity degrees calculated in the at least two 
different directions by the similarity degree calculating means is smaller than a prescribed 
threshold value. 

1 6. A storage medium in which an image processing program is stored that causes a 
computer to smooth image data that is formed by a plurality of pixels and includes at least 
one color component, the image processing program causing the computer to execute: 

a smoothing step of selectively performing, for at least one color component of a 
target pixel, smoothing that uses pieces of color information of at least one color 
component of the target pixel and of pixels adjacent to the target pixel among a plurality 
of pixels that form the image data, the smoothing done in accordance with correlation 
between the target pixel and pixels in the vicinity of the target pixel. 

1 7/ A storage medium in which an image processing program is stored that causes a 

L 

computer to smooth image data that is formed by a plurality of pixels and includes at least 
one color component, the image processing program causing the computer to execute: 

a similarity degree calculating step of calculating similarity degrees indicating 
similarity between a target pixel and pixels in the vicinity of the target pixel among a 
plurality of pixels that form the image data; 

a classifying step of classifying pixels whose similarity degrees have been 
calculated by the similarity degree calculating step into one of a plurality of groups having 
different similarity degree features; and 

a smoothing step of selecting a pixel to be subjected to smoothing from among a 
pixel that has been classified into a particular group in the plurality of groups and pixels 
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in the vicinity of the pixel that has been classified into the particular group, and for 
performing smoothing on color information of at least one color component of the 
selected pixel by using pieces of color information of at least one color component of the 
selected pixel and of pixels adjacent to the selected pixel. 
5 1 8. The storage medium storing the image processing program according to claim 1 7, 
wherein said smoothing step smoothes color information of a color component of a pixel 
adjacent to a pixel that has been classified into the particular group by the classifying step, 
and restores into its original state color information of a color component of a smoothed 
pixel among pixels adjacent to a pixel that has not been classified into the particular 
10 group by the classifying step. 

1 9. The storage medium storing the image processing program according to claim 1 8, 
wherein said smoothing step: 

sequentially selects pixels that became subjects of classification by the 
classifying step; 

15 smoothes color information of a color component of a pixel that is adjacent to not 

only a pixel selected at an arbitrary time point but also to a pixel that is not selected at the 
arbitrary time point when the selected pixel is classified into the particular group; and 

restores into its original state color information of a color component of a 
smoothed pixel among pixels adjacent to the pixel selected at the arbitrary time point 

20 when the selected pixel is not classified into the particular group. 

20. The storage medium storing the image processing program according to claim 1 7, 
wherein said smoothing step smoothes color information of a color component of a pixel 
that is adjacent to a plurality of pixels that have been classified into the particular group 
by the classifying step. 

25 21 . The storage medium storing the image processing program according to claim I 7, 
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wherein said smoothing step uses, as said particular group, a group having a feature that 
similarity degrees calculated in at least two different directions by the similarity degree 
calculating step are approximately the same. 

22. The storage medium storing the image processing program according to claim 2 1 , 
wherein said smoothing step judges that similarity degrees in at least two different 
directions are approximately the same when a difference between similarity degrees 
calculated in the at least two different directions by the similarity degree calculating step 
is smaller than a prescribed threshold value. 

23. A storage medium in which an image processing program is stored that causes a 
computer to smooth image data that is formed by a plurality of pixels and includes at least 
one color component, the image processing program causing the computer to execute: 

interpolating step for interpolating pieces of color information of a color 
component that is absent from pixels that are arranged at a prescribed pitch among pixels 
that form the image data; 

similarity degree calculating step for calculating similarity degrees in at least two 
different directions for each pixel to be a subject of interpolation by the interpolating 
step; 

classifying step for classifying each of pixels whose similarity degrees have been 
calculated by the similarity degree calculating step into one of a plurality of groups having 
different similarity degree features; and 

smoothing step for selecting a pixel to be subjected to smoothing from among a 
pixel that has been classified into a particular group in the plurality of groups and pixels 
in the vicinity of the pixel that has been classified into the particular group, and for 
performing smoothing on color information of a color component of the selected pixel by 
using pieces of color information of color components of the selected pixel and of pixels 
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adjacent to the selected pixel. 

24. The storage medium storing the image processing program according to claim 23, 
wherein said smoothing step performs the smoothing parallel with the interpolation by 
the interpolating step. 

25. The storage medium storing the image processing program according to claim 23, 
wherein: 

said interpolating step employs, as subjects of the interpolation, pixels that miss 
a color component having a highest spatial arrangement density; and 

said smoothing step smoothes color information of the color component having 
the highest spatial arrangement density of a pixel adjacent to a pixel that has been 
classified into the particular group. 

26. The storage medium storing the image processing program according to claim 23, 
wherein said smoothing step smoothes color information of a color component of a pixel 
adjacent to a pixel that has been classified into the particular group by the classifying step, 
and restores into its original state color information of a color component of a smoothed 
pixel among pixels adjacent to a pixel that has not been classified into the particular 
group by the classifying step. 

27. The storage medium storing the image processing program according to claim 26, 
wherein said smoothing step: 

sequentially selects pixels that became subjects of classification by the 
classifying step; 

smoothes color information of a color component of a pixel that is adjacent to not 
only a pixel selected at an arbitrary time point but also to a pixel that is not selected at the 
arbitrary time point when the selected pixel is classified into the particular group; and 

restores into its original state color information of a color component of a 



46 



smoothed pixel among pixels adjacent to the pixel selected at the arbitrary time point 
when the selected pixel is not classified into the particular group. 

28. The storage medium storing the image processing program according to claim 23, 
wherein said smoothing step smoothes color information of a color component of a pixel 
that is adjacent to a plurality of pixels that have been classified into the particular group 
by the classifying step. 

29. The storage medium storing the image processing program according to claim 23, 
wherein said smoothing step uses, as said particular group, a group having a feature that 
similarity degrees calculated in at least two different directions by the similarity degree 
calculating step are approximately the same. 

30. The storage medium storing the image processing program according to claim 29, 
wherein said smoothing step judges that similarity degrees in at least two different 
directions are approximately the same when a difference between similarity degrees 
calculated in the at least two different directions by the similarity degree calculating step 
is smaller than a prescribed threshold value. 
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